Real-time Talking Head Driven by Voice and its Application to Communication and Entertainment
نویسنده
چکیده
Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-toface communication environment. In this paper, we realize an avatar which has a real face in cyberspace and construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. And also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named "Fifteen Seconds of Fame" which is an example of interactive movie.
منابع مشابه
Real-time Voice Driven Facial Animation System - Systems, Man, and Cybernetics, 1999. IEEE SMC '99 Conference Proceedings. 1999 IEEE International
Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace to construct a multi-user -communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, t...
متن کاملRealistic Talking Head for Human-Car-Entertainment Services
The rapid development of in-car communication systems in recent years has created problematic human interface challenges. Modern human-computer interfaces are integrated into car's communication systems to make its functionality easily accessible. This paper presents a realistic talking head, which enables a user interface with multi-modality. A talking head in human-car interfaces allows a mor...
متن کاملText2Video: Text-Driven Facial Animation using MPEG-4
We present a complete system for the automatic creation of talking head video sequences from text messages. Our system converts the text into MPEG-4 Facial Animation Parameters and synthetic voice. A user selected 3D character will perform lip movements synchronized to the speech data. The 3D models created from a single image vary from realistic people to cartoon characters. A voice selection ...
متن کاملDescribing "INTERFACE" a Matlab© Tool for Building Talking Heads
INTERFACE is a Matlab©.tool for simplifying and automating many of the operations needed for building a talking head. INTERFACE consists of set of processing tools, focusing on dynamic articulatory data physically extracted by an automatic optotracking 3D movement analyzer. The final aim of INTERFACE is that of building up the animation engine of LUCIA our emotive/expressive Italian talking hea...
متن کاملHyperMask: Talking Head Projected onto Real Objects
HyperMask is a system which projects an animated face onto a physical mask, worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera, and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the ...
متن کامل